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ABSTRACT 

This fourth in a series of six learning aodules on 
instructional evaluation is designed to give secondary and 
postsecondary vocational teachers help in devising and adainisterxng 
evaluation devices for assessing student perforaance in an , . ^ 
occupational skills area. The terainal objective for the aodule is to 
assess student psychoBotor^(skills) perforaance in an actual school 
situation. Introductory sections relate the coapetency dealt with in 
this Bodule to others in the prograa and list both the enabling 
objectives for the three learning experiences and the resources 
requited. Materials in the learning experiences include reguired 
reading, self-check guiz, aodel answers, perforaance checklists, and 
the teacher perforaance assessaent fori for use in evaluation of the 
terainal objective. (The aodules on instructional evaluation are part 
of a larger series of 100 perforaance-tased teacher education (PBTE) 
self-contained learning packages for use in preservice or inservice 
training of teachers in all occupational areas. Each of the 
field-tested aodules focuses on the develop aent of cne or acre 
specific professional coapetencies identified through research as 
iaportant to vocational teachers. Hater ials re designed for use by 
teachers, either on an individual or group basis, working under the 
direction of one or acre resource persons/instructors.) (EH) 
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FOR^ORD 



TMt iiiodM li on# of • ••rtw of 100 pwformance-basad 
ttichtr •ducfltlon {PBTh) Itamlng packaoM focusing upon 
ifMcHIc profwtional comp^ttnciM of vocttional tMChers. The 
comptltnclM upon which thMe modulyt aro bated wery Wen- 
tifMand wtfM throuqh reeearch being importaQt to suc- 
oeeefUl vocational teaching at both the secondary and post- 
aecondary levels of Instnjctlon. The modules are suitable for 
the prepmitidh of teachers in all occupational areas. 
Each module provides learning experiences that integrate 
theoiy end application; each culminates with criterion refer- 
enced aseeeament of the teacher's performance of the spec- 
ified oompetenoy. The materials are designed for use by Irjdi- 
vMhiai or groupe of teachers in training working under the 
dfrectton and With the assistance of teecheredMcators acting as 
•eeouroe persons. Reeource persons should be skilled in the 
teacher competency being devetoped and shouM be thor- 
oughly oriented to PBTE concepts and procedures in using 
these materials. 

Thedeeigri of the materials provkJes consMerable flexibiiity for 
iHanning and conducting performance-based prsservice and 
Ineervloe teacher preparatton proorams to meet a )»rt<le variety 
of kidividual needs and interesn. The materials are intended for 
uee by universities and colleges, State departments of educa- 
tk>n» post-secondary institutions, k)cal education agencies, and 
others reeponsible for the profesetonardevetopment of voca- 
ttonal teechers. Further information about the use of the mod- 
ulea in teacher educatkm programs is contained in three 
lated documents: Bliidtnt duMto to Using PerfDrmanoe-Baeed 
Teacher Educatfon Materiala, Resource Pereon^uMe to 
UekM Performance-Besed Teacher Education Materiala and 
QuhSe to Implementation of Perfonnanoe-Baaed Teacher 
Education. 

The PBTE cuniculum packages are products of a sustairM9d 
research and devek>pment effort by The Center's Program for 
Professtonai Development for Vocationai Education. Many in- 
divMuals, institutions, and agencies participated with The Cen- 
ter ar)d have made contributions to the systematic devetop- 
nwnt, testing, revision, and refinement of these very significant 
training materials. Over 40 teacher educators provided input in 
' devetopment of initial versions of the modules; over 2.000 
teachers and 300 resource persons in 20 universities, colleges, 
and post-secondary mstitutions used the materials and pro- 
vided feedback to The Center for reviston and refinement. 

Special recognition for major individuai roies in the direction, 
development, coordination of testing, revision, and refinement 
of theee materiais is extended to the foilowing program staff: 
James B. Hamilton. Pro<jram Director; Robert t. Norton. As- 



sociate Program Director; Qlen E. Fardig, Specialftt; Lois Har- 
rington, Program Assistant; and Karen Quinn, Program Awle- 
tant. Recognitton is also extendedMo J<rlsty Ross. Technteaf 
Assistant; Joan Jones, Technteal Aaalstant; and Jean WIs^ 
baugh. Artist for their contributions to the final reflnement of 
the materials. Contributions mar<e by fojtoac program staff to- 
ward developmenUi versions of theee material^ are aleo ac- 
knowledged. Calvin J. Cotrsli directed the vocaAonal teacher 
competency reeearch studies upon which theee modules m 
based and also directed Jhe cuniculum devetopment effort 
from 1971-1972. Curtis R. Finch provided leadership for the 
program from 1972-1974. 

Abpreciatton is also extended to all those outsWe TW Center 
(Consultants, fWd site coordinators, teacher educ^ors, 
teachers, and others) who contributed so generously \n vartous 
phases of the total effort. Early verstons of the materials were 
devetoped by The Center In cooperatton with the vocattonal 
teacher educatton faculties at Oregon State Unhjerslty aiMi at 
ihe University of Missouri-Columbia. Prsilmlnary testlrig of the 
materials was conducted at Oregon State University, Temple 
University, and University of Missouri-Columbia. 

Foilowing prsllminary testing, ma|6r revision of ali materiais 
was performed by Center Staff with the assistance of numerous 
consultants and visiting scholars from throughout the country. 
Advanced testing of the materials was carried out with Msis- 
taoce of the vocational teacher educators and studenta of Cen- 
trfiwashlngton State College; Colorado Stata University; Ferrte 
State College, Mk5higan; Florida State Unh«rslty; Holland Coh 
lege, P.E.I., Canadr. Oklahoma State Unlvereity; Rutgers Unl- 
veSity; Stata University College at Buffato; Temple Unlverstty; 
University of Arizona; University of Mlchigan-Rlnt; University of 
Minnesota-Twin Cities; University of Nebraska-Lincoln; Univer- 
sity of Northern Colorado; University of Pittsburgh; Univewtty 
of Tennessee; University of Vermont; and Utah State Univereity. 

The Center is grateful to the Nattonal Institute of Education for 
sponsorship of this PBTE curriculum devetopment effort from 
1972 through Ita completton. Appreclatton is extended tothe 
Bureau of Occupattonal and AduK Education of the U.S. Office 
of Education for their sporworship of training land sdyMced 
testing of the materials at 10 sites under orovistons of EPDA 
Part F, Sectton 553. Recognitton of funding support of the 
advanced testing effort Is also extended tp Ferris State College, 
Holland College, Temple Univsrsity, and the University of 
Mtohigan-Rint. 

Robert E. Taylor 
Directoi 

' The C^ "tar for vocational Educatton 
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TM.CCMTtM Hm VOCAT10WAL iOUCATION 

n» Om Km nt» UM»« Mb^ Ci K wIii (»n 4Jlie 

The Center for Vocationai Education's mission is to 
increase the ability of dtverae agencies. Institutions, and 
organizations to solve educational problems relating to 
Individual career planning and preparation The Center 
fulfills its mission t)y: 

• Generating Icnow/ledge through research 

• Developing educational programs end products 

• Evaluating individual program needs and outcomes 

• InsUlling educatloQal programs and products 

• Operating information systems and services. 

• Conducting leadership development and training 
programs. 



AMERICAN ASSOCIATION 
FOR VOCATIONAL 
INSTRUCTIONAL MATERIALS 

Engineering Center 
Athens, Georgia 30602 

The American Aaeociation tor Vocational Instructional 
Materials (AAVIM) is an interstats organization of unlver^ 
sities. collegee and divisions of vocational education de- 
voted to the improvement of teaching throu9h better in- 
formation and teaching aids. 
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INTRODUCTION 



The very nature of vocational eoucatton requires 
that studante be trained in the skills needed to 
perform on the job. Since these are "performance" 
skille, many of the objectives in vocational educa- 
tion fall within the psychomotor, or physical sl<ills. 
afaa. Moat perfontiance objectives include learn* 
Ing from all three areas of learning: cognitive 
(knowkiclge), affective (attitudes and values), and 
psychomotor (skills). For example, to achieve the 
overall objective. "Tune an engine so it runs 
smoothly." involves knowledge (e.g.. "know the 
parts of the engine"), attitudes (e.g.. "value a 
smooth-running engine"), and skills (e.g.. "dem- 
onstrate skill in gappihg spark plugs"). 




This module is concerned with assessing the 
psychomotor (skill) objectives and/or the skill 
areas within a broad objective. This invojves the 
evaluation of both the precast used by students in 
meeting an objective (how they go about the task), 
and the product they create as a result of that 
process.- 

Evaluatiofi in the skills area of instructional ob- 
jectives requires more than giving a paper-and- 
pencil type of test. It is logical that if you want to 
know whether a person can do something, you 
watch him/her do it. and judge the performance 
for yourself. This requires the development of ob- 
servational devices such as checklists and rating- 
scales which '^an be used to evaluate both the 
procedures the student used and the product that 
was completed. These devices, if adequately de- 
veloped, can be used both by the teacher and by 
students. Involving students in their own evalua- 
tion through the use of specially constructed de- 
vices involves them in the learning process, helps 
them develop a sense of self-worth and indepen- 
dence, and. most important, trains students to 
recognize acceptable standards of workmanship. 

This moduli is designed to give you skills in 
devising and administering evaluation devices for 
assessing .student performance in thj occupa- 
tional skills area— devices that are valid and leli- 
abl3 and readily usable by both you and your stu- 
dents. 
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ABOUT THIS MODULE 



Oll|«GtlV«S 




EwaMNn OMtc t iv i ; 

\ 1. An«r completlnfl the required reading, demonstrate 
* knowlMge of trie Important considerations^ involved 
Ih selecting and administering evaluation devices for 
asaessing student psychomotor performance^(Learn- 
Ing Exp9ri0ncB /). 
2. After completing the required reading, construct a 
performance test for evaluating student achievement 
of a psychomotor performance objective (Learning 
Experience //). 

Resources 

A list of the outside resources which supplement those 
contiifned within the module follows. Check with your 
resout'ce person (1 ) to determine the availability and the 
location of these resources. (2) to locate additional ref- 
ereh<ies in your occupational specialty, and (3) to get 
assistance in setting up activities with peers or obsen/a- 
tlons of skilled teachers, if necessary. Your resource 



person may also be contacted »f you have any difficulty 
wiih directions, or in assessing your progress at any 
time. 

Lsaming Experience I 

Optional 

Reference: Leighbody. G. B. and P,^M. Kidd. 
Methods of Teaching Shop and Technical Subject, 
New York. NY: Delmar Publishers. 1966. 
Reference: Boyd. Joseph L.. Jr. and Benjamin 
Shimberg. Handbook of Performance Testing.- 
Princeton. NJ: Educational Testing Service, 1971. 
Reference: Popham. W. James. 'Eva/uaf/nV/nsfre/o- 
f/on, Englewood Cliffs, fll: Prentice-Hall. 1973. 

Leeming Experience II 

Optional 

Reference: Popham. W. James. E valuating Instruc- 
f/on. Englewood Cliffs. HJ\ Prentice-Hall. 1973. 

Learning Experience III 

Required 

An actual school situation in which you can assess 
student'psychomotor performance. 
A resource person to assess your competency in 
assessing student psychomotor performance. 
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Thlt modula covtrt ptrformanct atemfnt numbtt'S 141. 142. 144-146. 
15^ 155. 157. 150. 160 from CiMn J Cotrtll %t •/.. h4odt Curricul9 (or 
y^^mffl tnd T9Chnk!Ml Bductition: R900rt No. V (Cplumbut. OH: Th« 
Ctntor for Vdcat^nal Education. Tht Ohio State Unlvtrt«ty). Tha 364 
atamanta In thla documant form tha raaoarch t>aM for all Tha Cantar'a 
PBTE modula davalopmant. 

For informatton a|)out tha ganarai organizatton of aach modula. gariarai 
prooaduraa for thair uaa. tj\6 tarmlrwlogy which it common to alt 100 
modulaa. taa At>out Using Tha Cantar'a PBTE Modulat on tha inalda 

t>«sK co^r 



Learning Experience I 



OVERVIEW 




For information on psychomotor objectives and on how to select and 
administer devices to evaluate student achievement of this type of objec- 
tive, read the following information sheet: 



SELECTING AND ADMINISTERING EVALUATION 
DEVICES TO ASSESS STUDENT PSYCHOMOTOR 
PERFORMANCE 

Psychomotor oBjactives involve motor or skillA 
centered activities. This^pe oi objective (threadV 
sewing machine, light a blowtorch, correct a typ- 
ing error, install a piston! typically involves (1) fol- 
lowing a particular secfbence of procedures, (2) 
perfon^ing each procedure to. a certain level of 
competency, and/or (3) creating an end product or 
result which meets certain criteria. Any one or all of 
these three areas cctp be evaluated through obser- 
.vations. 

Objectives which are primarily concerned with 
sidlls are recognizable by their use of action verbs 
which indicate a very specific sidll. For example— 
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Stock 
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Evaluation Devices 

When you. as a vocational teacher, want to de- 
termine whether a student has achieved a desired 
skill, you may look at the process the student went 
through, the final product that the student pro- 
duced, or perhaps both. Sometimes, following the 
correct process is all important when, for example, 
a child care worker teaches children a new game, 
or a receptionist, handles a client who wants an 
appointment. At other times, it is far better to 
evaluate the final product (e.g.. a threaded pipe, a 



pressed garment, or manicured fingernails) to 
whether the student has achTSvedltie skill. 

Some skills must not only result in a product of 
acceptable quality, but must be done in a very 
carefully prescrit>ed way. In taking a dental X-ray, 
for instance, not pnly must the developed X*ray be 
technically correbt, but the picture-taking proce- 
dure mus(t be folljowed exactly in order to prevent 
injury to patient and technician. 
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Ch^^.Xllsti and rating scalot are corVimonly^ 
used to evaluate the processes used and products 
pioduced by students. Vfell-constructed check- 
lists and rating scales contain explicit criteria 
for judgiofl student performance. These criteria 
Relp the evahjator to focus his or her observations 
on the critical aspects of the objectives, and to 
assure that these observations are as objective as 
possible. 

In most cases, checklists are appropriate for 
evaluating procedures (process), and rating scales 
are appropriate for evaluating products. This is not 
a hard-and-fast rule, but. it is generally valid. If 
tpaclfic procedures are listed, then the checklist 
(YES or NO) Is appropriate because each detailed 
step was either accomplished or not. For example, 
if a student is being evaluated on procedures used 
in preparing^a cske, a^ item on a checklist might 
be "stirred the batterljntil smooth." This could be 
answered YES or NO. 

On the other hand, in evaluating the final prod- 
uct, it is preferable to evaluate more than simply 
whether or not criteria were accomplished. You 
also need to indicate the quality of the perfor- 
mance, for this, the rating scale »s more appropri- 
ate. For example, when that cake is finally made, 
one of the evaluation criteria br\ the rating scale 
could be "The texture of the cake was uniform." 
The uniformity of the texture could then be rated 
, on a scale from 1-5, from "non-uniform and/or 
lumpy" to "very uniform and smooth." 

The use of 
the checklist > 
versus the 
, rating scale 
will vafry 
somewhat 
based on the 
toler^ces 
allowlBd for 
successful 
perfoimance. 
Where quah 
itative judg- 
ments are 
important, / 
the rating f/ 
scale is the most useful device. Where tolerances 
are close or "either/or" performances are in- 
volved, the checklist is more useful. The use of 
checklists and rating scales is especially appro-: 
priate when (1) you are administering a perfor- 
mance test, and (2) you are evaluating student 
psychomotor performance in the classroom, labo- 
ratory, or on the job. A discussion of these situa- 
tions follows. 



Performance Tests , 

One of the most useful method? for determfhing 
the level of^he students* skill is by giving a perfor- 
mance test. In this type of test, a problem or task 
j(e.g., "weld an aluminum casting") i§ specified. 
<^he studentyare then required to solve the probr 
lem or perfdrm the task using the supplies and 
equipment fl)^n^shed to them. As each student per- 
forms, you WoWld observe ^nd evaluate the proce- 
dures followed. At the conclusion of the perfor- 
mance, the finished products are also evaluated. 

Performance tests can sometimes be used to 
determine the level at which students cian perform 
particular skills prior to instruction. Instruction, 
thus, can be based on the students* need for addi- 
tional skill., There is little point in teaching a skill if 
the stuclgnt^can already do it. Caution has to oe 
exercised in using performance tests as a pret?st if 
safety hazards are involved in the performance. 
Performance tests can also be used to pre-assess 
the level of stOdent performance when it would be 
costly or uncorrectable for a mistake to be made 
during the process. For example, a student can be 
asked to spray-paint a spare fender before spray- 
ing a customer's automobile. 





Some abilities require mastery. It is essential, for 
instancy, for a nurse to master the cntical task of 
giving a patient a hypodermic injection, or for a 
pilot to land an airplane successfully. In such 
cases, in which everyone must reach a given level 
(defined as mastery), it is imperative that such 
abilities be evaluated by performance tests. 

Many teachers use performance tests at the end 
of a demonstration when only simple skills are 
involved (e.g., using simple tools correctly). This 
allows you to get immediate feedback on the effec- 
tiveness of the demonstration and how much e^ch 
student learned from it. In the case of more com- 
plex skills, students need an opportunity to prac- 
tice the skills before being given a performance 



test. In other cases, such as with typing oKshort- 
^ hand skills, it is useful to administer performance 
tests on the sanrte skills periodically over a space of 
asemeeteror more. * 

Performance tests need to t)e'carefully planned . 
Tbis planning may involve^ all or mostpf thefollow- 
iog: 

• devising th* situations or problems the stu- 
dents will be required to complete based on 
the unit: or lesson objectives^ ^ 

•t developing a stbdent task sheet in which you 
explain the tasks to be completed 

• lisfing the materials, equipment, tools, etc.,. 
that will be available to the student 

• establishing criteria or standards for evaluat- 
ing the'psychomotor performance* 

decid ing what type of evaluation device to u§ej 

• developing the evaluation checklist or rating 
scale 

To provide ,«|i^dents ,with timii for preparation 
and practice, tney need to* be infoVmed in advance 
about upcoming performance tests. They should 
be told the purpose of the test and the time of the 
Jest. If students are to be tested individually, the 
other members of the class need to know what 
they will be expected to do when they are not 
involved 'n the testing. During their preparation/ 
practice time, students pan be provided with 
copies of the performance test to use in sell- 
evaluating their own competency. This not only 




gives them feedback which vill allow them to cor- 
rect errorfe; it also helps develop thetr ability to 
recognize qulality, procedures and products. 

• In competency-based vocational programs, per- 
formance testing is a basic and essential compo- 
nent Very likely, the checklists or testing instru- 



ments will be included in the learning packages or 
modules the students complete in such programs. 
Students know in advance of instruction wKatper- 
formance is required of. them, and what standards 
they will be expected to achieve. They can, thus, 
study and practice until they think they are ready to 
demonstrate the skilK ^t thai point, they arrange 
with the instructor for the time and place of the 
performance test. 

Performance tests are usually administered to 
one student at^iime, since it is essential to check 
the performahcestep by step, as well as to check 
the completed product or end results. If the skills 
perforn:ance does nof involve very small manipu- 
lations, it may be possible to administer a perfor- 
mance test to a small gtoup of stuaents, providing 
you can f)e positioned so as to obse^e every stu- 
dent. In addition to arranging the testing situation 
so that you can'closely observe the peffo'rmaQce, 
you need to be sure that you have all necessary 
materials and eifuipment available and properly 
placed fpr the test ahead of time. 

In situations in which the product is the primary 
concern, close observation of the procedure may 
not be necessary. In that case, students can work 
independently and simply turn in the product to 
the teacher when it is completed. Even ip thissitua- 
tion, however, it is very desirable for you to rate the^ 
product in tho student's presence. In this way. you 
can suggest improvements, and the student can 
ask questions about the work, if necessary. 

During testing, you also need to make sure that 
other students ffTe not working in the same physi- 
cal area in which the testing is being, conducted, 
and that their activities will not distract or interfere 
with the students being tested. Following the test- 
ing, you should have i follow-up conference with^ 
each student to discuss your assessment of the 
performance. This helpsstudentsunderstand their 
progress and the areas of their performance need- 
ing improvement. 

Testing Situations 

In the cla^nroom, performance testing can be 
used to evaluate the efficiency and effectiveness of 
students' skills in performing such operations as 
using a calculator, drawing plans, or writing short- 
hand Checklists and rating scales could be de- 
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in tat)oratory situations in which students are 
practicing to improve their levels of performance, 
they can use checklists tP evaluate the procedures 
used, and rating scales to evaluate their products. 



These same devices can then be usbd by the 
teacher in the final performance test; 

The evaluation of psychonjotor performance of 
students in on-the-job situations can be^shared by 
the employer and the student since you are not 
IDresent to observe Ihe student at all times, if you ' 
decide to use employers or on-the-job instructors 
to help you rate student perfonnance on the job. 
you need to explain to them (1) how tp use 
checklists and rating scales to assess perfor- 
mance. (2)' what standards of performance the 
scale levels represent, (3) hoW these devices relate 
to the achievement of the objectives of the on-the- 
job experience, and (4) what meth$^s can be used 
to involve students |o|he evaluation process. You 
also need to suggest that a time schedule be de- ^ 
veloped for making these wHtten oi^servatlons. 
This ensures that when you make your on-the-job 
visits, you will be able to see .what progress your 
students have madvto date. 



( 

V 



Optional 
Activity 



« ^ 

For further information on selecting and administering checklists and 
rating scales, you may wish to read Leighbody and Kidd, Methods of 
Teaching Shop and Technical Subjects, pp. 120-123; Boyd and Shfmberg, 
Handt>ook of Performance Testing, pp. 1-29 and 76-179; and/or Popham, 
Evaluating Instruction, pp. 83-104. 
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The following items checK your comprehension ot the matertal in ina 
information sheet, Selecting and Administering Evaluation Devices to As- 
S98S Student Psychomotor Perfbrmance, Each of the five items 

requires a short o»i<iy-type response. Please explain fully, but briefly, and 
^mal(e sure you respond to all plarts of each item. 



SELF-CHECK 

W Write an objective for your occup&tional specialty that is primarly concerned with a skill (in the 
psychomotor domain), and explain why it can be classified as being in the psychomotor don^ain.^ 

\ 



2. Place a check (^) before es^h of the following" verbs that could be used in writing a psychomotor 
objective. ' . 

^Plan Stretc- . -Guide 

m Praise Fill Paste 

Analyze Watch Read 

3. Why is it important to have specff ic devices for making written observations of student psychomotor 
performance? 



4. For one of the following objectives, explain how a checklist, rating scale, or both couW be used to 

evaluate student psychomotor performance. 
♦ a. Using an electric sand^r. sand a walnut coffee table in preparation for the application of a lacquer 
finibh. 
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b. Using a yeast roll dough, form Parker House rolls and place in tins ready for the oven. 



c. GIvenatypewritten lettercontaining an error, correcttheerrorso that thecon-ectionisnotvisible. 



5. In administering psychomotor performance tests, what procedures should you follow? 
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Compare your written responses on the Self-Check with the Model An- 
swers given below. Your responses need not exactly duplicate the model 
responses; however, you should have covered the same major points. 



MODEL ANSWERS 

1. Your psychomotor objective should contain (a) 
an action verb, (b) a statement of a motor skill to 
be performed, (c) a statement of the procMures 
to be followed, and (d) a statement of what the 
finished product is to be. For example, Using a 
prepared manuscript, type a copy of the manu- 
script at 32 words per minute with fewer than 
eight errors in 12 minutes or less." 

2. Plan J:!- Stretch J^f. Guide 

Praise Paste 

Analyse Watch Read 

Note that the checked words describe observa- 
ble motor behavior. The other words are verbs, 
but are not psychomotor in character and/or 
the actions described are difficult or impossible 
to observe to be sure that the student is actually 
performing the skill (e.g., "read"). 

3. We, as teachers, need guides to direct our ob- 
servations. Since checklists and rating scales 
contain crite»*ia for student performance, they 
provide guidance in helping make a teacher's 
observations more valid, reliable, objective, and 
complSte. 

4. For each of the three objectives, a checklist 
could be used to check the procedures used by 



the student in preparing the coffee table using ar 
Sander, forming Parker House rolls and placing 
them in tins, or correcting a typing error. A 
rating scale could then be used to judge the 
quality of the sanded wood, the quality of the 
shaped rolls, or the quality of the correction. 

5. The administration of a psychomotor perfor- 
mance test should follow these guidelines. 

• Inform students in advance of the upcoming 
performance test.^ 

• Discuss with students how they will be 
evaluated, and on what skills they will be 
evaluated. If they will be self-evaluating, pro- 
vide them with copies of the evaluation de- 
vices and explain how to use them. 

• Prepare the classroom and/or laboratory 
prior to testing. Make sure you have all mate- 
rials and equipment available and placed ap- 
propriately, and that you can view the perfor- 
mance easily and clearly. 

• Arrange for students to be working on mean- 
ingful activities away from the testing area 
when they are not involved in the testing. 

• Observe and rate student performance. 

• Hold a follow-up conference with students to 
explain ratings they received. 



4EVEL0FPEBF0RMANCE: Your completed Self-Check should have covered the same major points as 
the model responses. If you missed some points or have questions about any additional poirtts you 
' made review the material in the information sheet. Selecting and Administering Evaluation Devices to 
Assess Student Psychomotor Performance, pp. 6-9, or check with your resource person if necessary. 



13 



NOTES 



lb 

O 14 

ERIC 



!^ 

Learning Experience il 



OVERVIEW 




For information on how to plan for and construct psychomotor perfor- 
mance tests, read the following information sheet: 




CONSTRUCTING PSYCHOMOTOR PERFORMANCE 
TESTS 

Six major steps 
should be followed in 
constructing a per- 
formance test to 
measure achieve- 
ment of an occupa- 
tional sIdllWhen the 
psychomotor slclll is 
complex, all of these 
steps need to be / 
carefully followed. 
However, in the case 
of simple taslcs, some 
of steps (e.g., #2 and 
#3) may be omitted. 

Step 1: Devising Situations oi Probiems 

When developing statements describing a situa- 
tion or problem, you need to be sure that specific 
oetails^re given and that the solution involves the 
psychomotor performance (slcill) you want to mea- 
sure. For exj^p\e— 




Step 3: Listing Materiais, Equipment, 

Toois, etc. 

When administering a performance test, you 
usually furnish the\materials, tools, equipment, 
etc. that will be needed by the student. These items 
should be listed on the task sheet. This is espe- 
cially helpful to students who are using perfor- 
mance tests to practice and self-evaluate. For ex- 
ample, the Hst developed for the situation de- 
scribed above would probably read-- 





In this situation, the specific role assigned to 
students is described as "preparing to do sales 
worl< by worl<ing in afabric shop," and the problem 
situation is described as "a customer has cslced for 
a quarter of a yard of velvet fabric " 

Step 2: Developing a Task Sheet 

Before developing the tasl< sheet, you need lo' 
decide how detailed a. explanation you want to 
give. You can give a vur/ brief description, requir- 
ing the student to then fill in the details using 
•knowledge and experience from previous lessons, 
or you can provide the needed details for the stu- 
dent For example- 



Step 4: Developing Criteria for 
Performance 

The performance criteria, which are usually 
stated as part of the psychomotor objective, sen/e 
as a standard for evaluating overall student per- 
formance. Standards for many psychomotor ob- 
jectives have already been established by manu- 
facturers of the ec^'uipment being use^, by busi- 
nesses in which the skill is used, or by textbook 
and manual authors. Some labor unions also have 
established minimum levels of performance. Voca- 
tional teachers are often also exposed to stan- 
dards of performance in the technical courses they 
take at the post-secondary or college level. 



16 



16 



the criterfa stated within the objective need to 
be further broken out into sub-criteria of greater 
specificity. Sub-criteria are not part of the state- 
ment of the objective, but are listed separately. 
They t"*eli out in more detail the procedures and 
key points the teacher will be looking for as the 
studont perlorrns the overall skill. These sub- 
criter^can be used in the checklist or rating scale 
you w^ll use for evaluating s\udent psychomotor 
perforhiance. They should also be included on the 
task sheet. For example, sub-criteria for the 
velvet-cytting objective could be specified as 
follows:\ 




Step 5: Deciding on Evaluation Strategy 

In developing a performance test, sometimes 
you will want to evaluate the process used (the 
procedures followed), sometimes the final prod- 
uct, and at other times both process and product. 




Evalufition of the final product may be the best 
choice if (1) the result is more critical than the 
procedures used to make it, (2) there are several 
possible equally acceptable processes that may be 
usejJ, or (3) the process is difficult to observe and 
evaluate (e.g. developing film in conr^plete dark- 
nes ^ 

P. ^ce$8 evaluation is needed (1) if you want to 
be sure a student can use tools and equipnrient 
correctly, (2) if the time used to complete the pro- 
pess is of concern, (3) it there are health or safety 
hazards involved in the process, or (4) if the final 
product cannoi be Cvahjated without destroying 
the work. The process is usually evaluated by a 
checklist. If the product is to be evaluated , a rating 
scale is usually used. The sub-criteria developed 
for Step 4 are used in the body of the checklist 
and/or rating scale sirce they are the standards for 
student performance. 

In some performance testing situations, you may 
wf nt to pre-establish points at which student per- 
formance can be halted by.the observer/evaiuator. 
For instance, if expensive material would be ruined 
if the siudent were to continue on his or her pres- 
ent c( urse, or if an important safe* precaution 
were to be overlooked by the stude i, the perfor- 
mance should be stopped immediately. 

In the case" of the velvet-cutting situation, a 
checklist could be developed to evaluate the cut- 
ting prccass, and a rating scale could be de- 
veloped to evaluate the finished ,irnduct, the cut 
cloth. There could be points established in the 
process checklist for stopping the performance if 
it looks as if the velvet will be ruined if the student 
were to continue. 

Step 6: Developing the Evaluation 
Instrument 

Once you have determined the sub-criteria for 
•the performance and the type of evaluation 
rtraiegy to be fohovi/ed, you can develop the evalu- 
ation instriiment(s) needed. 

if you v^... be evaluating the process that the 
student followed, the evaluation device you will 
need to develop will usually be a checklist. The 
process checklist should contain (1) space for the 
student's name, (2) space for the date, (3) direc- 
tions for using the checklist, (4) a descriptive title, 
(5) criteria for^'evaluating the performance, and (6) 
YES and NO columns to check whether each item 
was completed or not. It is important to make the 
checklist self-explanatory so it can be used by stu- 
dents for self-evaluation purposes, by an employer 
or on-the-job instructor, as well as by you. An ex- 
ample of a cnecklist to evaluate process (in this 
case, velvet-cutting) is shown in Sample 1. 
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You will notice that in Sample 1 the checklist 
items come directly from the sub-criteria estab- 
lished for the process in Step 4. If you have com- 
pleted Step 4, establishing items is a fairly 
straightforward process. There are two cautions 
that should be observed in developing items from 
€ jb-criteria: (1) each item should be clearly and 
simply stated so that it communicates easily to 



students; teachers, and employers or on-the-job 
instructors, and (2) the items must not be trivial or 
common l^nowledge (e.g.. "the student used tbe 
shears with the proper hand"); they should be 
Important parte of the skill. The items should rep- 
resent all the critical steps involved in the process, 
and they should be listed in the order in which they 
are usually performed. ^ 



SAMPLE 1 




One other element sometimes inCluderj in a 
checklist is a space for comments bsMaih each 
item. This practice is strongly recommerided, in 
that it allows you to specify what exactly was 
wrong with the student's performance of a given 
Item— infomnation which is helpful in providing 
the student with feedback foltowing the perfor- 
mance test. It may also be useful to provide a 
column marked "NA" (Not Applicable) to be 
checked in situations in which the criteria are irv 
appropriate or do not apply (e.g.. where students^ 
may t>e performing on a variety of machines with 
slightly different controls). 



If the process is more complex 0{ more critfcal. 
or if you wish to evaluate the quality of the product, 
a rating scale is usually used. The rating scale 
allows you to be more discriminating in your 
evaluation of each student's performance. Instead 
of simply checking whether or not each item was 
completed, the rating scale allows yoU to indicate 
'how well it was completed. 

Authorities say that at least five levels of quality 

should be specified in a good rating scale, with 
deecriptiona given for at least three of the five 
levels. For example, the directions might indicate 
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that aU5SK will be used, and give a description 
for ^these levels asitfollows. 




Or. tne descriptors could be included in the scale 
itMlf. For example— 




As with the checklist, space can be left after each 
item for comments. 



Well-constructed product ratmg forms, contain- 
mg all of the essential quality criteria as well as 
explanations of the various levels of qual it> used in 
the rating scale, are very useful tools in teaching 
students to self-evaluate. Such rating scales can 
be constructed with two columns for rating the 
product (or process), one for the student, and one 
for the instructor. For example- 




After both the student and /instructor have rated 
the performance, a follow-tip' conference can be 
held to discuss difference$ irl^the ratings, to re- 
solve any questions the studerrt may have, and to 
determine whether the peffornripnce needs to be 
repeated. \ 

A rating scate prepared for the product resultirig 
from our velvet-cutting /situation is shown in 
Sample 2. Again, you wil! notice tt^at the items in 
the checklist were drawn directly from the sub- 
criteria developed in Step 4 for the . product. 
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SAMPLE 2 




Whether you are developing a checklist or a 
rating.scale, it is important that the device be both 
valid and reliable.3 The validity of a checklist or 
rating scale (whether it evaluates what it is sup- 
posed to) can be determined, in part, by examining 
the psychomotor objective and instructjonal con- 
tent to see that the device includes all the items 
that the student needs to perform during the pro- 
cess, or that the product must exhibit, for the stu- 
dent to achieve the objective. 

Also, the items can be compared against proce- 
dures or characteristics of quality items as listed in 
manuals and textbooks to be sure none are ortiit- 



ted. In addition, fellow teachers can review the 
devices to check for the clearness of the wording 
of the items and the completeness of the devices. 



3. To gain akill in constructing valid and raliabtt t«att to maaaurt 
•cNavamant of atijdont parformanca otoiactivaa. you may wish to rafar to 
Modula 0-2. Ataaaa Sm^nf Parformanca.' Knowl»dg: 
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TM ratability of a checklist or rating scale 
(whether It conaietently measures what it in- 
tended to meaaure) 48 largely determined by your 
paraonal experience with the device. The items 
need to be clear and detailed ^enough that your 
interpretation of an item is consistent each time 
you uae the device. In addition, you need practt^ 
in obaanring performances and recording your 
obeervationa, especially in a busy laboratory or 
ahop, or altuations in which you must observe 
group performance. 

^Sometimes you will find that you can only spot- • 
6mg)( performance' because of limits of time or 
group aizte In such cases, be sure that you make 
enough obsen^itions to be able to accurately as- 
fi^Kbw well e« ch student is performing, 
^mnalating tne results of checklists or rating 
acalee into a letter grade will depend to a certain 
extent orMtfHJr personal standards as an instructor 
and the plitlQSpphy of the sphool concerning grad- 
h j procedures.* For a checklist, the instructor 



may decide that a grade of A requires a perfect 
performance, a B is given for one or two unsatis- 
factory items, a C for three or four, and so on. 

A rating scale can be similarly graded, or the 
scores on each of the items can be summed and 
divided by tj^e^number of items to obtain a mean 
scorer^teffer grades can be given in accordance 
v^th this mean score (5=A, 4.5=A-, 4=B, etc.). 
None of these systems is completely satisfactory. 

In a„ competency-based program, the student is 
usually required to complete all itemson the rating 
scale with either a "good"or "excellent/" or is re- 
quired to continue to learn the skill. In this case, a 
grade of A can be reserved /Or those who do an 
outstanding job, while all other students get B* No 
matter what system is used, Students should be 
clearly infprmed about it before th<ey proceed with 
the test, in all student evaluation, but espacially in 
testing occupational skills, there should be no 
mystery <^ doubt about what is^to be expected of 
the student. 



4. To QtAn In dtvttoping a grading tystwn, you may wish to refar to 
Mo(iula D-5. 09frmirm Stud9nt Qnd^s 
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Optional 
Activity 



For further information on constructing performance tests, Voujriay wish 



^ to reaj* Popham. Evaluating Instruction, pp. 61*82. 




Select one or more student performance objectives in your occupational 
specialty which fall primarily in the psychomotor domain, and which in- 
volve both a prtiqess ar\d a product. 




Construct a performance ttet which could be used to assess students' 
achievement of the objecttve(s) you have selected. The performance test 
should include both a checl<li$t and a rating scale. 




After you have constructed your performance test, yse the Performance 
Test Checklist, pp. 23-24r4o^eva»aate ybur work. ^ 
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PERFORMANCE TEST CHECKLIST 



O^teMOM: Ptact an X in the NO, PARTIAL, or FULL box to indicate that 
MQh of tht following performance components was not accomplished, 
ptrttally accompllahed, or fully accomplished. If, because of special ctr- 
cumstanefs, a perfonmance componertfwas not applicable, or impossible 
to fxacuto, place an X in the N/A boic 



Namt 



Data 



Raaourca Paraon 



LEVEL OF PERFOfAHANCE 



Tho PtrforiMnco Test 

1. The problem or situation is appropriate for the psychomotor objec- 
tive 



2. The problem or situation is clearly stated 

3. The problem or situation is complete— all needed details are in- 
cluded . . .4- t ■ • 



4. The needed supplies and equipi^ent are specified 

5. Sub-criteria for pierformance are specified 

6. Appropriate evaluation devices are specified 



□ 
□ 



Tho ChocMlst 

' 7. Space is provided for student's name and date 

8. Directions include a clearly written explanation of how the checl<list 
l8 to be used 

9. The items in the checl<li3t are clearly written and easily interpreted 
by student and teacher 

10. The items are arranged in the sequence in which theskill is normally 
performed 

1 1 . The items include all the important steps of the process (procedure) 
being performed ' 

12. Space for written comments (e.g., diagnostic) is provided 

Th« Rating Scale 

13. Space Is provided for student's name and date 

14. Directions include a clear explanation of the various ratings 



15. The rating scale has at least a five-point scale with descriptors 
provided for at least three of the ratings 
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□ 

□ 

□ 

□ 

□ 
□ 

□ 
□ 

□ 



□ □ 

□ □ 



□ □□ 

□ □ □, 

□ DO- 

□ □ □ 



□ □ 

□ □ 

□ □ 

□ □ 

□ □ 

□ □ 

□ □ 

□ 9- 



23 



16. The items are clearly written and easily interpreted 

17. The items^are arranged in a logical sequence 

18. The items cover all of the qualities of the product as inhplkk 
objective 

ia space for written comments (e.g.. diagnostic) is provided 
Qentral . 

20. The checWfst, rating scale, and performance test have clei 
scriptive titles 









□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 








□ 


□ 


□ 



LEVEL OFPepFORMANCE: All items must receive FULL, or N/A responses. If any item receives a NO. or 
PARTIAL respoti^ review the material, in the information sheet. Constructing Psychomotor Perfor- 
mance Tests, pp. 1 6-2^ revise your performance test accordingly, or check virtth your r^sotirce person If 
necessary. 
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Learning Experience III 

FINAL EXPERIENCE 





NOTES 




TEACHER PERFORMANCE ASSESSMENT FORM 

A88t68 Student Performance: Skills (D-4) 



^ Name 

Mr^clloiis: Indicate the level of the teacher's accomplishment by placing 

en X in the approprFate box under the LEVEL OF PERFORMANCE heading, oaf 

ItHMcauae of special circumstances, a performance component was not 

appliciblf), or impossible to execute, place an X in the N/A box. r^mouTC9P^m>f^ 



LEVEL OF PERFORMANCE 



lh% Performance Teat 

1. The problem or situation is appropriate for the | — i 
psychomotor objective (is skill-centered) I — I 

2. The problem or situation is clearly stated lZ] 

3. The problem or situation is complete— all needed details rn 
are included : * — ' 

4. The needed supplies and equipment are specified O 

5. Sub-criteria for performance are specified Q 

6. Appropriate evaluation devices are specified Q 

The Checklist • ^ . p| 

7. Space js provided for student's name and date I — I 

8. Directions include a clearly written explanation of how i — i 
the checklist is to be used U— ' 

I 

9. The items in the^ checklist are clearly written and easily i — | 
interpreted ' — ' 

10. The items are arranged in the sequence in which the skill |— | 
is normally performed I — ' 

11 . the item? include all the important steps of the process i— | 
(procedure) being performed I — ' 

12. Space for written comments is provided C 

The Rating Scale | I 

13. Space is provided for student's name an J date . : I — I 

14. Directions include a clear explanation of the various rat- r-] 
ings ^ I — ^ 

15. The rating scale has at least a five-point scale with de- i — | 
spriptors provided for at least three of the ratings 1 — I 
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□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



/ / / / / 

16. The items are clearly written and easily interpreted — □ □ □ □ 

17. The items are arranged in a logical sequence D D D D 

18. The items cover all of the qualities of the product as i — i t i | i | | 
implied in the objective I — I ' — ' ' — ' ' — ' 

19. Space forwritten comments (e.g.. diagnostic) is provided □ □ □ □ 
Qemral 

20. The checklist, rating scale, and performance test have r — i | i | 11 I 
clearly descriptive titles I — ' ' — ' — ' ' — ' 

Administration 

21. The performance test was discussed with the . jents t i t i | i | | 
prior to giving the test I — ' ' — ' ' — ' ' — ' 

22. The students were prepared to self-evaluate their per- i — i | i | i | | 
formance (optional) ; ' — ' ' — ' ' — ' ' — ' 

23. The performance testing situation was arranged to allcKv i — i i i i i | i 
for teacher observation I — ' ' — ' ' — ' ' — ' 

24. Materials and equipment needed were assembled and i i | i | i I I 
9rran^ in advance 1— ' ' — ' ' — ' ' — ' 

25. Quiet was malntaineu n the testing area D D Q Q 

26. The teicher observed and recorded his or her observa- | — i | i I 11 I 
tions while the testing was occurring I — I I — I ' — ! ' — ' 

27. Students not involved in testing were provided with pi | — i i 11 1 
meanihgful activities to complete I — I ' — I ' — ' ' — ' 

28. The tedcher discussed with the students the results ["] ["1 ni ("1 
their performance ' — ' ' — ' ' — ' ' — ' 

LEVEL OF PERFORMANCE: All items must receive N/A, GOOD, or EXCELLENT responses. If any item 
• receives a NONE POOR, or FAIR response, the teacher and resource person should meet to determine 
whit additional activities the teacher needs to complete in order to reach competency m the weak 
area(s). 3y 
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ABOUT USING THE CENTER'S PBTE 
MODULES 
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OiQMiution 

' Esch module Is desl{|ned to help you gain competency 
irva particular skill area considered important to teach- 
ing success. A module Is made up of a series of learning 
experiences, somep^vlding background information, 
tome providing practice experiences, and others com- 
bining these two funptions. Completing these experi- 

/woes shoukl eeabto you to achieve the terminal objec- 
thre in ttie final learning experience. The final experience 
in each module always requires you to demonstrate the 
skill Ip ari actu«tSCtKK)l situation when you are an intern, 
a student teacher, or an inservice teacher. 

Procedures 

Modules are designed to allow you to individualize your 
iMcKer education program. You need to take only tTiose 
modules t^rfng skills which you do not already pos-- 
sessl STmilarly, you need not complete any learning ex- 
perience within a module if you already have the skill 
needed to complete it. Therefore, before taking any 
module, you should carefully review (1 ) the Introduction, 
(2) the Objectivos listed on p. 4, (3) the Oven^iews pre- 
(^ing each leamlrig experience, and (4) the Final Ex- 
perience. After comparing your present needs and com- 
petencies with the Information you have read in these 
• sections, you shou kj be ready to make one of the foHow- 
ing decisions: 

• that you do not have the competencies indicated, 
ar^ should complete the entire module 

• that you are competent in one or more of the en- 
abling objectives leading to the final learning ex- 
perience, and thus can omit that (those) learr^ing 
experience(s) 

' • that you are already competent in this area, and 
ready to complete the final Teaming experience in 
order to "test out" 

• that the^-module is inappropriate to your needs at 
this time 

When you are ready to take the final learning experience 
and have access to an actual school situation, make the 
necessary arrangements with your resource person. If 
yo^ do not complete the final experience successfully, 
meet with your resource person and arrange (1) to re- 
peat the experience, or (2) complete (or review) previous 
sections of the module or other related activities 
suggested by your resource person before attempting to 
repeat the final experience. 

Options for recycling are^lso available in each of the 
learning experiences preceding the final experience. 
Any time you do not meet the minimum level of perfor- 
mance required to meet an objective, you and your re- 

' source person may meet to select activities to help you 
reach competency This could involve (i) completing 
parts of the module previously skipped; (2) repeating 
activities; (3) reading supplementary resources or com- 
pleting additional activities suggested by the resource 
person; (4) designing your own learning experience; or 

' (5) completing some other activity suggested by you or 
your resource person. 
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Terminology 

Actual School Situation . . . refers to a situation in 
which you are actually working with, and responsible 
for, secondary or post-s^condarv vocational students in 
a real school. An intern, a student teacher, or an in- 
service teacher would be functioning in an actoal school 
situation. If you do not have access to an actual school 
situation when you are taking ttie module, you can com- 
plete the module up to the final learning experience. You 
would then do the final learning experience later; i.e.. 
when you have access to an actual school situation. • 
Alternate Activity or Feedback . . . refers to an item or 
feedback device which may aubiftltute for required 
items which, due to special circumstances, you are un- 
able t^ complete. 

Occupational Specialty . . . refers to a specific area of 
pi'eparation within a vocational service area (e.g., the 
service area Trade and Industrial Education Includes 
occupational specialties such as automobile me- 
chanics, welding, and electricity). 
Optional Activity or Feedback . . . refers to an item 
which is not required, but which is designed tp supple- 
ment and enrich the required items in a learn mg experi- 
ence. . « 
Resource Person . . . refers to the person in charge of 
your educational program; the professor, instructor, 
administrates supervisor, or cooperating/supervising/ 
classroom teacher who is guiding youuin laking this 
module. 

Student . . . refers to the person who is enrolled and 
receiving instruction in a secondary or post-secondary 
educational institution. 

Vocational Service Area . . . refersto a major vocational 
field: agricultural education, business and office educa- 
tion, distributive education, health occupations educa- 
tion, home economics education, industrial arts edu- 
cation, techmcal education, or trade and industrial edu- 
cation. 

You or the Teacher . . refers to the person who is tak- 
ing the module. 

Levels of Performance for Rnal Assessment 

N/A . . . The cnterion was not met because it was no^ 
applicable to the situation. 

None . . No attempt was made to meet the critenon, 
although it was r^levent. 

Poor . . . The teacher is unable to perform this skill or 
has only very limited ability to perform it. 
Fair . . . The teacher is unable to perform this skill in an 
acceptable manner, but has some ability to perform f(. 
Good . . . The teacher is able to perform this skill in an 
effective manner. 

-Excellent. . .Theteacherisableto perform this skill in a 
very effective rnanner. 
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